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TITLE OF THE INVENTION 
IMAGE PROCESSING SYSTEM, IMAGE PROCESSING APPARATUS, 
AND IMAGE PROCESSING METHOD 

FIELD OF THE INVENTION 

The present invention relates to an image 
processing system and method for encoding/decoding an 
image . 

BACKGROUND OF THE INVENTION 

Many image compression coding techniques have 
been proposed since a storage medium having a very 
large size is required to save an image with high 
resolution and high pixel precision as a raw image. 

For example, a technique for saving/transferring 
X-ray medical images in an electronic format, and using 
them in diagnosis has been proposed. In the medical 
field, images preferably have highest possible 
resolution, and an effective image compression method 
is demanded. 

On the other hand, various techniques for 
canceling noise appearing in images have been proposed 
and are used in various fields. 

However, no technique for effectively reducing 
noise in the image encoding/decoding process has been 
proposed yet. 




For example^ in an image sensing device using 
X-rays, the X-ray dosage upon image sensing is 
preferably as small as possible in consideration of the 
influences on a patient. But an image sensed with a 
small X-ray dosage contains many quantization noise 
components, which disturb diagnosis. As a method of 
reducing such quantization noise in a medical image, a 
method that exploits multiresolution analysis is known, 
as disclosed in Japanese Patent Laid-Open No. 09-212623. 
According to this technique, it is possible to remove 
noise based on the multiresolution analysis result of 
an image. However, in order to incorporate such method 
in a conventional apparatus, a noise removal process 
must be added. Also, when this method is combined with 
image coding, flexible adjustment of image quality is 
disturbed upon display. 

SUMMARY OF THE INVENTION 
The present invention has been made in 
20 consideration of the conventional problems, and has as 
its object to provide an image processing system, image 
processing apparatus, and image processing method, 
which can remove noise contained in an original image 
upon compressing/decompressing an image. 
25 In order to achieve the above object, an image 

processing system according to the present invention is 
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an image processing system for encoding and decoding an 
image, comprising : 

an encoding device for encoding an image in units 
of bit planes to generate a code sequence; and 
5 a decoding device for decoding the code sequence 

in units of bit planes to generate an image, 

wherein noise in an image is removed by deleting 
data of bit planes of levels lower than a lower-limit 
bit plane in the encoding device and/or the decoding 
10 device. 

Another image processing system according to the 
present invention is an image processing system for 
encoding and decoding an image, comprising: 

an encoding device for generating a code sequence 

15 by generating transform coefficients in units of a 
plurality of frequency ranges by means of frequency 
transformation of an image, and encoding the transform 
coefficients; and 

a decoding device for restoring the transform 

20 coefficients from the code sequence, reclaiming a 
reference image on the basis of the transform 
coefficients of a given frequency range of the restored 
transform coefficients, and removing noise by 
processing the transform coefficients of the frequency 

25 ranges other than the given frequency range on the 
basis of the reference image. 
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An image processing apparatus according to the 
present invention is an image processing apparatus for 
encoding an image, which generates a code sequence by 
encoding an image in units of bit planes, and removes 
5 noise on the image by deleting data of bit planes of 
levels lower than a lower-limit bit plane. 

Another image processing apparatus according to 
the present invention is an image processing apparatus 
for decoding an image, which reclaims an image by 
ffl 10 decoding an image in units of bit planes, and removes 

y1 noise on the image by deleting data of bit planes of 

fj levels lower than a lower-limit bit plane. 

Still another image processing apparatus 
% according to the present invention is an image 

n 15 processing apparatus for decoding an image, which 

^ restores transform coefficients from a code sequence 

obtained by computing and encoding frequency transforms 
of an image, and reclaims a reference image on the 
basis of the transform coefficients of a given 
20 frequency range of the restored transform coefficients, 
and 

removes noise by processing the transform 
coefficients of frequency ranges other than the given 
frequency range on the basis of the reference image. 
25 An image processing method according to the 

present invention is an image processing method for 
encoding and decoding an image, comprising: 

- 4 - 



an encoding step of encoding an image in units of 
bit planes to generate a code sequence; and 

a decoding step of decoding the code sequence in 
units of bit planes to generate an image, 

wherein noise on an image is removed by deleting 
data of bit planes of levels lower than a lower-limit 
bit plane in the encoding step and/or the decoding step. 

Another image processing method according to the 
present invention is an image processing method for 
decoding an image, comprising: 

a step of restoring transform coefficients from a 
code sequence obtained by computing and encoding 
frequency transforms of an image, and reclaiming a 
reference image on the basis of the transform 
coefficients of a given frequency range of the restored 
transform coefficients; and 

a step of removing noise by processing the 
transform coefficients of frequency ranges other than 
the given frequency range on the basis of the reference 
image . 

A computer program product according to the 
present invention embodies a program for implementing 
an image processing method for encoding and decoding an 
image, and the program comprises: 

program code for a encoding step of encoding an 
image in units of bit planes to generate a code 
sequence; and 



program code for a decoding step of decoding the 
code sequence in units of bit planes to generate an 
image, 

wherein noise on an image is removed by deleting 
5 data of bit planes of levels lower than a lower-limit 

bit plane in the encoding step and/or the decoding step. 

Another computer program product according to the 
present invention embodies a program for implementing 
an image processing method for decoding an image, and 
10 the program comprises: 

program code for a step of restoring transform 
coefficients from a code sequence obtained by computing 
and encoding frequency transforms of an image, and 
reclaiming a reference image on the basis of the 
15 transform coefficients of a given frequency range of 
the restored transform coefficients; and 

program code for a step of removing noise by 
processing the transform coefficients of frequency 
ranges other than the given frequency range on the 
20 basis of the reference image. 

A computer data signal according to the present 
invention is embodied in a propagating wave, is used 
for implementing an image processing method for 
encoding and decoding an image, and comprises: 
25 code signals used in an encoding step of encoding 

an image in units of bit planes to generate a code 
sequence; and 




code signals used in a decoding step of decoding 
the code sequence in units of bit planes to generate an 
image, 

wherein noise on an image is removed by deleting 
5 data of bit planes of levels lower than a lower-limit 

bit plane in the encoding step and/or the decoding step. 

Another computer data signal according to the 
present invention is embodied in a propagating wave, is 
used for implementing an image processing method for 
10 decoding an image, and comprises: 

code signals used in a step of restoring 
transform coefficients from a code sequence obtained by 
computing and encoding frequency transforms of an image, 
and reclaiming a reference image on the basis of the 
15 transform coefficients of a given frequency range of 
the restored transform coefficients; and 

code signals used in a step of removing noise by 
processing the transform coefficients of frequency 
ranges other than the given frequency range on the 
20 basis of the reference image. 

Other features and advantages of the present 
invention will be apparent from the following 
description taken in conjunction with the accompanying 
drawings, in which like reference characters designate 
25 the same or similar parts throughout the figures 
thereof . 
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BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a schematic block diagram showing an 
arrangement of an image processing system according to 
the first embodiment of the present invention; 
5 Fig. 2 is a block diagram showing an arrangement 

of an encoding device according to the first embodiment 
of the present inventions- 
Figs. 3A to 3C are views showing a basic 
arrangement of a discrete wavelet transformer according 
10 to the first embodiment of the present inventions- 
Fig. 4 is a view for explaining the operation of 
an entropy encoder according to the first embodiment of 
the present invention; 

Figs. 5A to 5D show the format of a code sequence 
15 according to the first embodiment of the present 
invention; 

Fig. 6 shows a format of a file according to the 
first embodiment of the present invention; 

Fig. 7 is a block diagram showing an arrangement 
20 of a decoding device according to the first embodiment 
of the present invention; 

Fig. 8 is a view for explaining the operation of 
an entropy decoder according to the first embodiment of 
the present invention; 
25 Figs, 9A and 9B are views showing an arrangement 

of an inverse discrete wavelet transformer according to 
the first embodiment of the present invention; 
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Fig. 10 is a flow chart showing the operation of 
the encoding device according to the first embodiment 
of the present invention; 

Fig. 11 is a flow chart showing the operation of 
5 the decoding device according to the first embodiment 
of the present invention; 

Fig. 12 is a block diagram showing an arrangement 
of a decoding device according to the second embodiment 
of the present invention; 
10 Fig. 13 is a block diagram showing an internal 

arrangement of an encoding device according to the 
third embodiment of the present invention; 

Fig. 14A shows an example of a mask generation 
method according to the third embodiment of the present 
15 invention. Fig. 14B shows quantization indices before a 
shift-up process, and Fig. 14C shows quantization 
indices after the shift-up process; 

Fig. ISA shows subbands broken up into code 
blocks CB according to the third embodiment of the 
20 present invention, and Fig. 15B is a view for 

explaining a bit plane encoding process in an entropy 
encoder; 

Fig. 16A shows a format of an overall code 
sequence according to the third embodiment of the 
25 present invention. Fig. 16B shows a main header MR, 

Fig. 16C shows a tile header TH, and Fig, 16D shows a 
format of a bitstream and a bit plane; 



Fig. 17 is a block diagram showing an arrangement 
of a decoding device according to the third embodiment 
of the present invention; 

Fig. 18 is a flow chart showing an image encoding 
process in the encoding device according to the third 
embodiment of the present invention; 

Fig. 19 is a flow chart showing an image decoding 
process done by the decoding device according to the 
third embodiment of the present invention; 

Fig. 20A shows quantization indices before a 
shift-down process according to the third embodiment of 
the present invention. Fig. 20B shows quantization 
indices in consideration of a lower-limit bit plane, 
and Fig. 20C shows quantization indices after the 
shift-down process ; 

Fig. 21 shows a state wherein an entropy encoder 
according to the fourth embodiment of the present 
invention executes a bit-shift process of quantization 
indices of a region of interest (ROI); 

Fig. 22 is a block diagram showing an arrangement 
of a decoding device according to the fourth embodiment 
of the present invention; 

Fig. 23 is a flow chart showing a flow of 
operation of the decoding device according to the 
fourth embodiment of the present invention; 



Fig. 24 is a block diagram showing an arrangement 

of an encoding device according to the fifth embodiment 

of the present inventions- 
Fig. 25 shows the relationship between an LL 

subband and a code block used to obtain a lower-limit 

bit planer- 
Fig. 26 is a flow chart of various processes done 

by the encoding device according to the fifth 

embodiment of the present inventions- 
Fig. 27 is a block diagram showing an arrangement 

of an encoding device according to the sixth embodiment 

of the present inventions- 
Fig, 28 shows the format of a code sequence 

generated by a code sequence forming unit according to 

the sixth embodiment of the present inventions- 
Fig, 29 is a schematic block diagram showing an 

arrangement of an encoding device according to the 

seventh embodiment of the present inventions' 

Figs. 30A to 30E show the format of a code 

sequence according to the seventh embodiment of the 

present invention; 

Fig, 31 is a block diagram showing an arrangement 

of a decoding device according to the seventh 

embodiment of the present invention; 

Fig. 32 shows an example of subbands upon 

generating a reference image according to the seventh 

embodiment of the present invention; 



Fig. 33 shows the relationship between transform 
coefficients to be processed, and a region on the 
reference image occupied by the transform coefficients 
according to the seventh embodiment of the present 
inventions- 
Fig. 34 is a graph for explaining an example of a 
function used upon executing a transform process of 
transform coefficient by an image quality improvement 
processor according to the seventh embodiment of the 
present invention ; 

Fig. 35 is a flow chart showing an encoding 
process in an image processing system according to the 
seventh embodiment of the present invention; 

Fig. 36 is a flow chart showing a decoding 
process in the image processing system according to the 
seventh embodiment of the present invention; and 

Fig, 37 shows another example of subbands upon 
generating the reference image according to the seventh 
embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Preferred embodiments of the present invention 
will be exemplified in detail hereinafter with 
reference to the accompanying drawings. Note that the 
scope of the present invention is not limited to the 
relative positions of building components, the 




processing order, and the like described in these 
embodiments unless otherwise specified. 
[ First Embodiment ] 

An image processing system for executing a series 
5 of processes when medical images are processed as an 
electronic format according to the first embodiment of 
the present invention will be described. 

Fig. 1 shows a schematic arrangement of an image 
processing system of this embodiment. Referring to 

10 Fig. .1, an image input device 1 is an image sensing 

device using X-rays, and generates and outputs required 
images using a sensor corresponding to a purpose 
intended. An image generated by this device has a 
resolution of 2500 x 2500 pixels (vertical x 

15 horizontal) or higher, and the precision of each pixel 
is expressed by 12 bits. Since a large-size storage 
medium is required to save such image having high 
resolution and high pixel precision as a raw image, the 
image undergoes compression coding as needed. 

20 An encoding device 2 in Fig. 1 is used to 

compress such image, and reversibly or irreversibly 
compression-encodes an image input from the image input 
device 1 by a predetermined scheme. Note that 
reversible compression that can completely preserve 

25 information contained in an image is prevalently used 
for medical images according to their purpose. As a 
compression encoding scheme therefor, a reversible 
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compression mode in JPEG as a compression encoding 
scheme recommended by ISO and ITU-T is used. Note that 
so-called JPEG2000 that computes the wavelet transforms 
of an image, and entropy-encodes transform coefficients 
5 in units of bit planes also allows reversible 

compression, and is suitable for compressing medical 
images . 

An image signal that has undergone compression 
encoding is outputted as a code sequence to a file 

10 output device 3. The file output device 3 forms a file 
format by appending information required for diagnosis 
(e.g., a patient's name, image sensing conditions, and 
the like) to the code sequence that has undergone 
compression encoding by the encoding device 2, and 

15 outputs the file to a storage/transfer device 4. The 
storage/transfer device 4 stores the converted data 
having the predetermined format as a file or transfers 
it to another device. 

Note that a storage medium uses a hard disk, MO, 

20 or the like, and a network or the like is used upon 

transfer. The following process is done to display the 
stored/transf erred data . 

The file output from the storage/transfer device 
4 is read by a file input device 5, and after required 

25 information is extracted from the file, the code 

sequence is outputted to a decoding device 6. The 
decoding device 6 decodes the input code sequence to 
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reclaim an original image signal, and outputs that 
signal to an image display device 7. The image display 
device 7 displays the input image signal, which is used 
in, e.g., diagnosis. 
5 Details of the encoding process in the image 

processing system according to this embodiment will be 
explained below using the flow chart in Fig. 10. 

In step S1201, an image signal is input from the 
image input device, and is outputted to the encoding 
10 device 2. 

Fig. 2 shows an arrangement of the encoding 
device 2 . 

In step S1202, a discrete wavelet transformer 
201 (Fig. 2) executes a transform process of the image 

15 signal input to the encoding device 2 to generate 

transform coefficients. The transform coefficients are 
encoded (entropy-encoded) by an entropy encoder 202. 

The internal arrangement of the encoding device 2 
will be described in detail below. 

20 The discrete wavelet transformer 201 executes a 

two-dimensional discrete wavelet transform process of 
the image signal input from the image input device 1, 
and computes and outputs transform coefficients. 

Fig. 3A shows a basic arrangement of the discrete 

25 wavelet transformer 201. An image signal input from 
the image input device 1 is stored in a memory 201A, 
and is sequentially read out by a processor 201B to 
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undergo a discrete wavelet transform process. As a 
result of discrete wavelet transformation, transform 
coefficients are generated, and are written in the 
memory 201A. Fig. 3B shows an internal arrangement of 
5 the processor 201B, As shown in Fig. 3B, the input 
image signal is separated into odd and even address 
signals by a combination of a delay element 301 and 
down samplers 302a and 302b. Furthermore, these 
O signals undergo filter processes of two filters p and u, 

m 10 In Fig. 3B, s and d represent low- and high-pass 

yi coefficients upon decomposing a linear image signal to 

one level, and are respectively computed by: 

d(n) - x(2n + 1) - floor{(x(2n) + x(2n + 2))/2) 

(1) 

15 s(n) = x(2n) + floor((d(n - 1) + d(n))/4) (2) 

where x(n) is an image signal at address n to be 
transformed, and floor (x) is a function of returning a 
maximum integer smaller than x. 

With this process, the linear discrete wavelet 
20 transform process is done for an image signal. Since 
two-dimensional discrete wavelet transformation is 
implemented by sequentially executing linear discrete 
wavelet transformation in the horizontal and vertical 
directions of an image and its details are known to 
25 those who are skilled in the art, a description thereof 
will be omitted. 
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Fig. 3C shows an example of a format of transform 
coefficient groups of two levels obtained by the 
two-dimensional discrete wavelet transform process. An 
image signal is decomposed into coefficient sequences 
HHl, HLl, LHl,..., and LL in different frequency bands. 
Note that a detailed description of discrete wavelet 
transformation will be omitted since it is a 
state-of-the-art technique as described in, e.g., 
Stephane G. Mallat, "A Theory for Multiresolution 
Signal Decomposition: The wavelet representation", IEEE 
Trans, on Pattern Analysis and Machine Intelligence, 
Vol. 11, No. 7, July 1989. This embodiment is based on 
a method of recursively decomposing low-frequency 
sequences. In the following description, these 
coefficient sequences will be referred to as subbands. 
The coefficients of the individual subbands are output 
to the entropy encoder 202. In Fig. 3C, the number of 
decompositions (levels) upon decomposing into frequency 
bands is 2, but the present invention is not limited to 
this, and an arbitrary number of decompositions equal 
to or larger than 1 may be used. 

The entropy encoder 202 decomposes the input 
transform coefficients into bit planes, executes binary 
arithmetic coding in units of bit planes, and outputs 
code sequences. 

Fig. 4 is a view for explaining the operation of 
the entropy encoder 202. Fig. 4 exemplifies a 4 x 4 



• 




15 



20 



25 



subband region which includes three nonzero 
quantization indices (+13, -6, +3) . The entropy 
encoder 202 scans the subband region to obtain a 
maximum value M, and computes the number S of bits 
required for expressing the maximum value M by: 



where ceil(x) is the smallest one of integers equal to 
or larger than x. This process corresponds to step 
S1203 in Fig. 10. 

In Fig, 4, since the maximum transform 
coefficient value is 13, as indicated by 401, S is 4 . 
Hence, 16 transform coefficients in the sequence are 
decomposed into four bit planes, as indicated by 402 in 
Fig. 4. This process corresponds to step S1204 in 
Fig. 10. The flow then advances to step S1205, and the 
entropy encoder 202 executes a process in units of bit 
planes. The entropy encoder 202 makes binary 
arithmetic coding of bits of the most significant bit 
plane (MSB) first, and outputs the coding result as a 
bitstream. Then, the encoder 202 lowers the bit plane 
by one level, and encodes bits of each bit plane to 
output a bitstream until the bit plane of interest 
reaches the least significant bit plane (LSB) . At this 
time, a sign of each transform coefficient is 
entropy-encoded immediately after the first nonzero bit 
is detected in the bit plane. In step S1206 in Fig. 10, 



S = ceil (log2 (abs (M) ) ) 



(3) 
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a code sequence containing bitstreams is generated and 
output . 

Figs. 5A to 5D show the format of a code sequence 
which is generated and outputted in this way. Fig. 5A 
shows an overall format of a code sequence, in which MH 
is a main header; TH, a tile header; and BS, a 
bitstream. As shown in Fig. 5B, the main header MH is 
comprised of the size (the numbers of pixels in the 
horizontal and vertical directions) of an image to be 
encoded, a size upon breaking up the image into tiles 
as a plurality of rectangular regions, the number of 
components indicating the number of color components, 
the size of each component, and component information 
indicating bit precision. In this embodiment, since an 
image is not broken up into tiles, the tile size is 
equal to the image size. When the image to be encoded 
is a monochrome, multi-valued image, the number of 
components is "1". 

Fig, 5C shows a format of the tile header TH. 
The tile header TH consists of a tile length including 
the bitstream length and header length of the tile of 
interest, and an encoding parameter for the tile of 
interest. The encoding parameter includes a discrete 
wavelet transform level, filter type, and the like. 
Fig. 5D shows a format of the bitstream of this- 
embodiment. The bitstream is formed in units of bit 
planes, which are arranged in the order from the MSB to 



the LSB. In each bit plane, the encoding results of 
the bit plane of transform coefficients in respective 
subbands are arranged in units of subbands . 

Also, S indicates the number of bits required for 
5 expressing a maximum quantization index, and is 

computed by equation (3) above. The code sequence 
generated in this manner is outputted to the file 
output device 3. 

g In the aforementioned processes, since an image 

m 10 signal is expressed as coefficients of integers as a 

m result of arithmetic operations of equations (1) and 

^ (2), and no information loss occurs in the subsequent 

~ entropy encoder 202, an original image can be 

^ completely reclaimed by decoding the generated code 

15 sequence (reversible compression) . 
□ In step S1207 in Fig. 10, the file output device 

3 forms a file to be stored in or transferred by the 
storage/transfer device 4 on the basis of the code 
sequence input from the encoding device 2 and 
20 additional data input from the image input device 1, 

At this time, the additional data input from the image 
input device 1 includes the name of the patient to be 
sensed, image sensing date. X-ray dosage upon image 
sensing, and the like. Fig. 6 shows an example of a 
25 file formed by combining the additional data and code 
sequence. The file output device 3 outputs the file 
with the format shown in Fig. 6 to the storage/transfer 
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device 4. In step S1208, the storage/transfer device 4 
stores the input file or outputs it to an external 
apparatus via, e.g., a network in accordance with a 
purpose intended. 

Details of the decoding process in the image 
processing system according to this embodiment will be 
explained below using the flow chart in Fig. 11. 

In step S1301, the file stored by the 
storage/transfer device 4 is read by the file input 
device 5 (Fig. 1) . In step S1302, the file input 
device 5 analyzes the input file and separates the file 
into data (the name of the patient to be sensed, image 
sensing date, and X-ray dosage upon image sensing) 
appended by the file output device 3, and the code 
sequence generated by the encoding device 2. The code 
sequence is outputted to the decoding device 6 to 
undergo a decoding process, and the X-ray dosage data 
in the data appended by the file output device 3 is 
also output to the decoding device 6, 

Fig. 7 is a block diagram showing an arrangement 
of the decoding device 6 in this embodiment. Reference 
numeral 601 denotes a code input unit; 602, an entropy 
decoder; and 603, an inverse wavelet . transformer . 

The code input unit 601 receives a code sequence, 
analyzes the headers (MH and TH) included in that 
sequence to extract parameters required for the 
subsequent processes, and controls the flow of 



processes if necessary or outputs required parameters 
to the subsequent processing units. The bitstreams 
included in the code sequence are output to the entropy 
decoder 602. 

The entropy decoder 602 decodes the bitstreams in 
units of bit planes and outputs the decoding result to 
the inverse discrete wavelet transformer 603. Fig. 8 
shows a process of the entropy decoder 602. 801 
illustrates the flow of sequentially decoding a given 
subband region to be decoded in units of bit planes, 
and bit planes are decoded from MSB to LSB to restore 
transform coefficients . 

Also, the entropy decoder 602 determines 
transform coefficient values to be output. to the 
inverse discrete wavelet transformer 603 on the basis 
of the X-ray dosage input from the file input device 5. 
The entropy decoder 602 computes a noise amount e 
determined from the X-ray dosage by a predetermined 
method (step S1303) , and then computes a lower-limit 
bit plane L (step S1304) by: 

L = ceil (log2 (e) ) + 1; 8 > 1 (4) 

L = 0; e = 0 (5) 
where £ is expressed by an integer equal to or larger 
than 1. The entropy decoder 602 checks subbands to 
which the restored transform coefficients belong (step 
S1305) , If the coefficient of interest belongs to a 
subband other than LL, the entropy decoder 602 aborts 




bit plane decoding in 801 at an L bit plane 
(lower-limit bit plane upon decoding) , sets zero in all 
bits contained in subsequent bit planes up to the LSB 
(step S1306) , and outputs them to the subsequent 
5 inverse discrete wavelet transformer 603. For example, 
when the lower-limit bit plane L is 1 in the 
coefficient distribution indicated by 801, since all 
transform coefficients contained in the LSB are 
p replaced by zero, coefficient values to be output to 

^ 10 the inverse discrete wavelet transformer 603 are 12, 6, 

J and 2. 

^ When the restored transform coefficient belongs 

J" to an LL subband, all bit planes are decoded ordinarily 

^ (step S1307) . 

15 Figs. 9A and 93 are block diagrams showing an 

O arrangement and processing of the inverse discrete 

wavelet transformer 603. Referring to Fig. 9A, the 
input transform coefficients are stored in a memory 
603A. A processor 603B executes a linear inverse 
20 discrete wavelet transform process and implements a 
two-dimensional inverse discrete wavelet transform 
process by sequentially reading out the transform 
coefficients from the memory 603A (step S1308) , The 
two-dimensional inverse discrete wavelet transform 
25 process is executed in a sequence opposite to the 

forward transform, but since the details are known to 
those who are skilled in the art, a description thereof 
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will be omitted. Fig. 9B shows a processing blocks of 
the processor 603B, The input transform coefficients 
undergo two filter processes of filters u and p, and 
are added to each other after being up-sampled, thus 
outputting an image signal x' , These processes are 
described by: 

X' (2n)=s' (n) -floor ( (d ' (n-l ) +d ' (n) ) /4 ) (6) 

X' (2n+l)=d' (n)+floor ( (x' (2n)+x' (2n+2) ) /2) (7) . 

With the aforementioned processes, the image is 
reclaimed, and is outputted to and displayed on the 
image display device 7 which comprises a CRT, liquid 
crystal display, or the like (step S1309) . 

As described above, according to this embodiment, 
transform coefficients obtained by a discrete wavelet 
transform process of an image are encoded in units of 
bit planes in turn from the MSB bit plane. In a 
process for decoding this code sequence, a bit plane 
corresponding to the value of the noise amount € is 
used as a lower-limit bit plane upon decoding. In this 
manner, when an image contains noise, a decoded image 
from which noise components are removed can be obtained 

Note that the lower-limit bit plane may be 
determined in units of subbands . 

Note also that the program codes according to the 
flow charts shown in Figs. 10 and 11 are stored in a 
memory such as a ROM, RAM, or the like (not shown) of 
the encoding or decoding device. 




[Second Embodiment] 

In the decoding device of the first embodiment, 
the lower-limit bit plane of the transform coefficient 
to be decoded is controlled in accordance with the 
5 noise amount e. But in some cases, a noise removal 
process need be controlled more flexibly. As the 
second embodiment of the present invention devised to 
this end, a decoding device having an arrangement for 
p implementing a noise removal process by finer control 

m 10 will be explained. Since the arrangement of the 

I = i 

m overall image processing system and building components 

^1 other than the decoding device 6 are the same as those 

^ in the first embodiment, a description thereof will be 

y omitted. 

15 Fig. 12 shows an arrangement of the decoding 

O device 6 according to this embodiment. 

Referring to Fig. 12, a code sequence output from 
the code input unit 601 is decoded by the entropy 
decoder 602 in units of bit planes. In this embodiment, 
20 the entropy decoder 602 decodes all the input bit 

planes, and outputs restored transform coefficients to 
a coefficient processor 604. The coefficient processor 
604 computes a noise amount e determined from the X-ray 
dosage input from the file input device 6 by a 
25 predetermined method, and then computes a lower-limit 
bit plane L based on equations (4) and (5). The 
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coefficient processor 604 then computes transform 



coefficients c' corrected by: 



= c; abs (c) > 2^ 



(8) 



= sign(c) (abs (c) - T) ; abs (c) < 2 



L 



(9) 



o 



=4= 

^ 15 



20 



for transform coefficients of subbands other than LL 
from a predetermined threshold value T based on the 
noise component 8, and outputs the computed 
coefficients . 

The inverse discrete wavelet transformer 603 
computes inverse transforms using c', and outputs a 
reclaimed image to the image display device 7. 

With the aforementioned processes, transform 
coefficients contained in bit planes below the bit 
plane L undergo a threshold value process by setting a 
predetermined threshold value, thus achieving a noise 
removal process at finer level in the decoding process. 

The process for correcting transform coefficients 
using equations (8) and (9) can be executed before step 
S1308 in Fig. 11. 

In the first and second embodiments, transform 
coefficients are directly entropy-encoded upon encoding. 
Alternatively, quantization may be done prior to 
entropy encoding. In this case, dequant izat ion is done 
after entropy decoding in the decoding process. 
[Third Embodiment ] 
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An image processing system according to the third 
embodiment of the present invention will be described 
below . 

Since the schematic arrangement and functions of 
5 the image processing system according to this 

embodiment are basically the same as those described in 
the first embodiment using Fig. 1, a repetitive 
description thereof will be avoided. 

In this embodiment, the encoding device 2 and 
10 decoding device 6 have different internal arrangements 
from those in the first embodiment. Hence, these 
differences will be mainly explained below. 

Fig. 13 shows an internal arrangement of the 
encoding device 2 according to this embodiment. An 
15 image signal input to the encoding device 2 undergoes 

discrete wavelet transformation in the discrete wavelet 
transformer 201 as in the first embodiment to generate 
transform coefficients. The generated transform 
coefficients are input to and quantized by a quantizer 
20 203, and the obtained quantization indices are encoded 
by the entropy encoder 202. The operations of the 
respective units will be explained below. 

Since the discrete wavelet transformer 201 has 
the same arrangement and functions as those described 
25 in the first embodiment using Fig. 3, a description 
thereof will be omitted. 
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The quantizer 203 quantizes the input 
coefficients by a predetermined quantization step, and 
outputs indices (quantization indices) corresponding to 
the quantized values. In this case, quantization is 
5 described by: 

q = sign (c) floor (abs (c) /A) (10) 
sign(c) - 1; c > 0 (11) 
sign(c) = -1; c < 0 (12) 
f3 where q is the quantization index, c is a coefficient 

10 to be quantized, and A is the quantization step. In 

this embodiment, the value A includes "1" and, in this 
case, no quantization is done in practice. The 
obtained quantization indices are output to the entropy 
encoder 202. 

15 The region designation unit 204 determines an ROI 

(Region Of Interest) in an image to be encoded, and 
generates mask information indicating coefficients that 
belong to the ROI upon computing the discrete wavelet 
transforms of the input image. In this embodiment, a 
20 region defined by coefficients equal to or higher than 
a predetermined value of those in an LL subband in the 
subband structure shown in Fig. 3C in the first 
embodiment is determined as the ROI. The left side in 
Fig. 14A shows an example in case of a chest image. In 
25 this case, lung portions (regions) having high 
luminance level are selected as ROIs, 
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Furthermore, Fig, 14A shows an example upon 
generating a mark. When the ROIs are designated, shown 
in the left side in Fig. 14A, the region designation 
unit 204 computes portions where the designated ROIs 
are included in respective subbands upon computing the 
discrete wavelet transforms of the image including 
these designated ROIs. Assume that mask information 
bits in each ROI are "1", and other mask information 
bits are "0". Note that the region indicated by this 
mask information corresponds to a range including 
transform coefficients of the surrounding region 
required for reconstructing an image signal on the 
boundary of each designated ROI. Since the position of 
each mask information corresponds to that of a 
transform coefficient obtained by two-dimensional 
discrete wavelet transformation, whether or not a 
coefficient at a given position belongs to the 
designated ROI can be identified by checking the 
corresponding bit in the mask information. The mask 
information generated in this way is outputted to the 
entropy encoder 202. 

If bit planes shown in, e.g.. Fig. 14B are 
obtained when the entropy encoder 202 operates normally, 
bit planes of quantization indices which belong to the 
ROIs are shifted up (i.e., to the MSB side), as shown 
in Fig. 14C. 



That is. Figs. 14B and 14C show a change in 
quantization indices by the shift-up process. In 
Fig. 14B, a total of six quantization indices that 
belong to the ROIs are present, and quantization 
indices after the shift-up process are as shown in 
Fig. 14C. 

In this manner, all bit planes of the ROIs in a 
given subband do not overlap those of quantization 
indices of a non-ROI region. 

More specifically, the entropy encoder 202 
computes a shift value B therefor. Furthermore, the 
entropy encoder 202 changes quantization indices based 
on the mask information input from the region 
designation unit 204 by: 

q* = q X 2^; m = 1 (13) 

q' = q; m = 0 (14) 
where m is the mask value at the position of the 
quantization index of interest. 

With the aforementioned process, only the 
quantization indices which belong to the ROIs 
designated by the region designation unit 204 are 
shifted up by B bits and, after that, the entropy 
encoder 202 encodes in units of bit planes. 

The entropy encoder 202 decomposes the 
quantization indices into bit planes in units of 
rectangular regions (to be referred to as code blocks 
hereinafter) obtained by segmenting a subband into a 



predetermined size in correspondence with the input 
quantization indices, and makes binary arithmetic 
coding in units of bit planes, thus outputting 
bitstreams. 

Fig. 15A shows subbands broken up into code 
blocks CB. In Fig. 15A, for example, an LL subband is 
broken up into four code blocks CBO to CB3, and 
quantization indices in these code blocks are encoded 
in units of bit planes in the order of CBO, CBl, CB2, 
and CB3. 

The entropy encoder 202 scans the entire subband 
to obtain a maximum value M, and computes the number S 
of bits required to express a quantization index 
indicating the maximum value M as in the first 
embodiment- Furthermore, the entropy encoder 202 
similarly computes the maximum number SB of bits from a 
maximum quantization index value in each code block. 

Fig. 15B is a view for explaining an operation of 
bit plane encoding in the entropy encoder 202. 
Fig. 15B exemplifies a 4 x 4 subband region which 
includes three nonzero quantization indices (+13, -6, 
+ 3) . The entropy encoder 202 scans the entire code 
block to obtain a maximum value MB, and computes the 
number SB of bits required for expressing a maximum 
quantization index by: 

SB = ceil (log2 (abs (MB) ) ) (15) 



In 161 of Fig. 15B, since the maximum coefficient 
value MB is "13", equation (15) yields SB = 4 . 
Therefore, 16 quantization indices in the code block 
are decomposed into four bit planes, as indicated by 
162. The entropy encoder 202 executes a stream process 
in units of those bit planes. The encoder 202 makes 
binary arithmetic coding of bits of the most 
significant bit plane (MSB) first, and outputs the 
coding result as a bitstream. Then, the encoder 202 
lowers the bit plane by one level, and encodes bits of 
each bit plane to output a bitstream until the bit 
plane of interest reaches the least significant bit 
plane (LSB) . At this time, a sign of each transform 
coefficient is entropy-encoded immediately after the 
first nonzero bit is detected in the bit plane. 

Note that each bit plane undergoes a one-pass 
process, but may undergo processes in a plurality of 
passes . 

In the aforementioned quantization index encoding 
process, the entropy encoder 202 shifts up quantization 
index values that belong to the ROIs by B bits, and 
then encodes in turn from the MSB bit plane. In this 
manner, bits of quantization indices of the ROIs occupy 
the former half of encoded data in each code block. 

Figs. 16A to 16D show the format of the code 
sequence which is generated and outputted in this way. 
Fig. 16A shows an overall format of a code sequence, in 
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which MH is a main header; TH, a tile header; and BS, a 
bitstream. As shown in Fig, 16B, the main header MH is 
comprised of the size (the numbers of pixels in the 
horizontal and vertical directions) of an image to be 
encoded, a size upon breaking up the image into tiles 
as a plurality of rectangular regions, the number of 
components indicating the number of color components, 
the size of each component, and component information 
indicating bit precision. In this embodiment, since an 
image is not broken up into tiles, the tile size is 
equal to the image size. When the image to be encoded 
is a monochrome multi-valued image, the number of 
components is- "1". 

Fig. 16C shows a format of the tile header TH . 
The tile header TH consists of a tile length including 
the bitstream length and header length of the tile of 
interest, an encoding parameter for the tile of 
interest, and the bit shift value of each subband for 
quantization indices that belong to the designated ROI. 
The encoding parameter includes a discrete wavelet 
transform level, the number S of maximum bit planes of 
each subband, and the like. 

Fig. 16D shows a format of the bitstream in this 
embodiment. As shown in the upper column in Fig. 16D, 
a bitstream is formed in units of subbands, which are 
arranged in ascending order of resolution to have a 
subband with the lowest resolution at the head position. 



Furthermore, in each subband, as shown in the middle 
column of Fig. 16D, codes are arranged in units of bit 
planes in the order from the upper to lower bit planes. 
Furthermore, the codes of each bit plane are set 
5 in units of code blocks, as shown in the lower column 
in Fig. 16D, and PH contains the number SB of bits of a 
maximum bit plane of each code block, the difference 
from the number S of bits of the corresponding bit 
plane, information indicating that no significant code 

10 sequence is contained (e.g., quantization indices in 
each code block are all "0"s), and the like. 

Note that data of bits equal to or larger than 
the number SB of bits of a code block (the number SB of 
bits) , the number of bits of which is less than S, are 

15 processed as zero. 

The code sequence formed in this manner is 
outputted to the file output device 3. 

The file output device 3 forms a file to be saved 
or transferred on the basis of the code sequence input 

20 from the encoding device 2, and various. data input from 
the image input device 1, as in the first embodiment. 
Various data include the name of the patient to be 
sensed, image sensing date. X-ray dosage upon image 
sensing, and the like. These data are combined with 

25 the aforementioned code sequence, and are output to the 
storage/transfer device 4 as a single file. The 
storage/transfer device 4 stores the input file or 

- 34 - 



# 



outputs it to an external apparatus via, e.g., a 
network in accordance with the purpose intended. 

The operation upon displaying an image in the 
decoding device of this embodiment will be explained 
5 below. An image file stored by the storage/transfer 
device 4 is read by the file input device 5 as in the 
first embodiment. The file input device 5 analyzes the 
input file and separates the file into an appended 
Q information part, and a code sequence generated by the 

2 10 encoding device 2, and outputs the code sequence to the 

decoding device 6 for a decoding process. 
J: The internal arrangement of the decoding device 6 

^ will be explained below. The functions of respective 

O units will be explained first, and the overall 

N= 15 operation of the decoding device 6 will then be 

□ explained. 

Fig. 17 is a block diagram showing an arrangement 
of the decoding device 6. Reference numeral 601 
denotes a code input unit; 602, an entropy decoder; 604, 
20 a dequantizer; and 603, an inverse discrete wavelet 
transformer , 

Since the code input unit 601 has the same 
arrangement and functions as those in the first 
embodiment, a description thereof will be omitted. 
25 Unlike in the first embodiment, the entropy 

decoder 602 according to this embodiment sets a 
lower-limit bit plane to be decoded upon decoding bit 
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planes, and aborts a decoding process of bit planes 
below the lower-limit bit plane. After the lower-limit 
bit plane is decoded, restored quantization indices are 
shifted down (i.e., to the LSB side). That is, on the 
5 basis of the bit shift value B of the corresponding 
subband read out from the tile header TH, a 
quantization index that assumes a value exceeding 2^ is 
shifted down by: 

O q = qV2^• q' ^ 0 (16) 

m 10 q = 0; q' = 0 (17) 

yi where q is the quantization index after the shift down 

^ process, q' is the quantization index before the shift 

^ down process, and B is the bit shift value read out 

from the tile header. With this process, the 
^ 15 quantization indices which are shifted up, as shown in 

p Fig. 14C, are shifted down, as shown in Fig. 14B. That 

is, the bit planes of the quantization indices of the 
ROI and non-ROI region are adjusted to those before the 
bit-shift process, and are output to the dequantizer 
20 604. 

In a dequantization process, the dequantizer 604 
sets zero in bits contained in bit planes which are not 
decoded, and restores discrete wavelet transform 
coefficients by: 
25 c'=Axq;q7i:0 (18) 

c'-0;q=0 (19) 
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where q is the quantization index, and A is the 
quantization step, which is the same value used upon 
encoding. c' is the restored discrete wavelet 
transform coefficient. 

The inverse discrete wavelet transformer 603 
executes the same two-dimensional inverse discrete 
wavelet transformation as that described in the first 
embodiment using Fig. 9 and equations (6) and (7). 
That is, the input transform coefficients undergo two 
filter processes of filters u and p, and are added to 
each other after being up-sampled, thus outputting an 
image signal x'. With the aforementioned processes, an 
image is reclaimed, and is outputted to and displayed 
on the image display device 7 which comprises a CRT, 
liquid crystal display, or the like. 

Since the forward and inverse discrete wavelet 
transform processes given by equations (13), (14), (18), 
and (19) satisfy a perfect reconstruction condition, 
the restored image signal x' matches the original image 
signal x as long as the quantization step A is "1" and 
all bit planes are decoded in bit plane decoding in 
this embodiment. 

Figs. 18 and 19 are respectively flow charts 
which summarize the aforementioned image encoding and 
decoding processes in the encoding and decoding devices 
mentioned above. Note that program codes according to 
those flow charts are stored in memories such as ROMs, 



RAMs, or the like (not shown) in the encoding and 
decoding devices, and are read out and executed by a 
CPU (not shown) . 

The flow chart of the image encoding process 
shown in Fig. 18 will be described first. 

The encoding device 2 generates discrete wavelet 
transformation of an image signal input from the image 
input device 1 (step S1601) . The region designation 
unit 204 determines an ROI by the aforementioned method 
on the basis of coefficient .values in an LL subband of 
those generated by the discrete wavelet transformation, 
and generates mask information indicating the ROI (step 
S1602) , 

All coefficients obtained in step S1601 are 
quantized by the quantizer 203 to generate quantization 
indices (step S1603) . The entropy encoder 202 computes 
a shift value B of quantization indices by the method 
mentioned above (step S1604). The entropy encoder 202 
specifies quantization indices within the ROI of those 
generated in step S1603 using the mask information 
generated in step S1602, and shifts the specified 
quantization indices within the ROI by the shift value 
B obtained in step S1604 (step S1605) . 

The quantization indices of each bit plane 
obtained as a result of the aforementioned process 
undergo binary arithmetic coding in units of code 
blocks (step S1606) . A bitstream shown in Fig. 16 is 



generated using a code sequence obtained by this coding 
and various headers mentioned above (step S1607). The 
file output device 3 generates a file using the 
bitstream and the aforementioned information from the 
image input device 1, and the storage/transfer device 4 
outputs the file externally (to, e.g., the file input 
device 5) (step S1608) . The output destination of the 
file in step S1608 is not limited to an external device 
For example, the file may be output to and stored in a 
predetermined memory (not shown) in the encoding device 
Note that this predetermined memory (not shown) may be 
the storage/transfer device 4 in Fig. 1. 

The flow chart of the image decoding process in 
the decoding device shown in Fig. 19 will be explained 
below . 

The file input device 5 separates the input file 
into a code sequence contained therein, and the 
information appended by the file output device 3 (step 
SlOO) . The decoding device 6 reads out only codes 
corresponding to the LL subband from the code sequence, 
decodes and dequantizes these codes to restore 
coefficients of the LL subband, and stores the 
coefficients in a memory (not shown) (step SlOl) . 

The decoding device 6 then reads out a code 
sequence corresponding to one subband from the 
subsequent code sequence (step S102) . This subband is 



one of those containing high-pass coefficients other 
than LL- 

The decoding device 6 sets and stores a 
lower-limit bit plane, which is used to decode discrete 
wavelet transform coefficients belonging to a non-ROI 
region, on the basis of the coefficients of the LL 
subband stored in the memory (not shown) (step S103) . 
In the method of setting the lower-limit bit plane 
position, for example, the average value of the 
coefficient values in the LL subband is used. 

The entropy decoder 602 decodes all bit planes of 
quantization indices which are contained in the code 
sequence of the subband read in step S102 and belong to 
the ROI (step S104), That is, the. decoder 602 reclaims 
quantization indices contained in the ROI from the code 
sequence of the subband read in step S102. In this way, 
portions indicated by the ROI in Fig. 20A are decoded. 

Furthermore, the entropy decoder 602 decodes 
codes corresponding to one bit plane of quantization 
indices that belong to the non-ROI region so as to 
reconstruct that bit plane (step S105) . 

It is checked if the bit plane reconstructed in 
step S105 is the lower-limit bit plane determined in 
step S103 (step S106) . If the reconstructed bit plane 
is the lower-limit bit plane, the flow advances to step 
S107; otherwise, the flow returns to step S105 to 
proceed with a decoding process of the next lower bit 



plane. That is, as shown in Fig. 20B, the decoder 602 
decodes bit planes from the most significant bit plane 

(MSB) to the lower-limit bit plane. 

Upon checking in step S106 if the bit plane 
reconstructed in step S105 is the lower-limit bit plane, 
the number that specifies the lower-limit bit plane 

(e.g., the number indicating the order of bit plane 
from the MSB) is stored in step S103. Then, a variable, 
which has been reset to zero before the process 
according to this flow chart, is incremented by 1 every 
time the aforementioned decoding process is done in 
step S105, and the checking process in step S106 is 
attained by comparing this variable and the number 
stored in step S103. 

Then, quantization indices, the values of which 
are larger than 2^ (those within the ROI) , are shifted 
down by B bits, and after the shift process, the 
dequantizer 604 dequantizes all the quantization 
indices (step S107) . At this time, dequantization is 
done while setting zero in non-decoded bits in 
quantization indices that belong to the non-ROI region. 
Fig. 20C shows quantization indices after the 
shift-down process by B bits. Bits with x marks in 
quantization indices of the non-ROI region in Fig. 20C 
are not decoded and are forcibly set at zero. 

It is then checked if a decoding process for all 
subbands is complete (step S108). If subbands to be 



processed still remain, the flow returns to step S102 
to execute the processes in step S102 and the 
subsequent steps for an unprocessed subband. 

The inverse discrete wavelet transformer 603 
5 computes the inverse discrete wavelet transforms of the 
transform coefficients obtained by dequantization to 
reclaim an image, and outputs it to the image display 
device 7 (step S109) . As a result, the original image 
is reconstructed, and is displayed on the image display 

10 device 7 . 

In this way, all quantization indices of the ROI 
set upon encoding are perfectly restored, but lower 
bits of the non-ROI region are discarded. Hence, 
discrete wavelet transform coefficient values 

15 corresponding to fine variations are removed. 

Therefore, when a sensed image contains noise, an image 
from which fine noise components are removed can be 
obtained by appropriately selecting bit planes to be 
restored upon decoding. 

20 In this embodiment, the ROI is set based on the 

coefficient values of the LL subband upon encoding. In 
addition, when a low-luminance region with many 
quantization noise components is determined from 
coefficient values and is set to be a non-ROI region, a 

25 higher noise removal effect can be obtained. 

In this embodiment, the coefficient values of the 
LL subband are referred to upon determining the 

- 42 - 



lower-limit bit plane of decoding. Alternatively, the 
X-ray dosage upon image sensing may be contained as a 
parameter in the code sequence, and the lower-limit bit 
plane of decoding may be determined based on that 
5 parameter, 

[ Fourth Embodiment ] 

An image processing system according to the 
fourth embodiment of the present invention will be 
O explained below. 

ffl 10 In the third embodiment, the shift value B is 

y! determined for quantization indices of the ROI upon 

nil decoding an image, so as to completely separate that 

bit plane from quantization indices of the non-ROI 
^ region. Alternatively, the bit shift value B may be 

^ 15 determined by another method. Since the arrangement 

p and functions of the overall system are substantially 

the same as those in the third embodiment, differences 

from the third embodiment will be explained in this 

embodiment . 

20 Fig. 21 shows a state wherein the entropy encoder 

202 in this embodiment executes a bit-shift process of 
quantization indices of the ROI. In Fig, 21, the 
quantization indices of the ROI are shifted up by B 
bits. Unlike in the third embodiment, bit planes of 

25 the quantization indices of the ROI overlap those of 
the quantization indices of the non-ROI region. In 
this embodiment, the shift value B is selected based on 
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a noise level determined from the coefficients of the 
LL subband. That is, if e represents the noise level, 
B that satisfies: 



is selected. Furthermore, the lower-limit bit plane is 
the one B bits upper than the least significant bit 
plane (LSB) . In this way, the shift value B and the 
lower limit position of the bit planes to be decoded 
can be simultaneously adjusted in correspondence with 
the noise level. Note that the noise level £ can be 
calculated by a known method. 

After the quantization indices are shifted based 
on the shift value B given by equation (20), encoding 
is done in the same manner as in the third embodiment. 

Fig. 22 shows an arrangement of the decoding 
device 6. The code input unit 601 outputs shape data 
of the aforementioned ROI extracted from the input code 
sequence to a mask generator 605. The mask generator 
605 generates a mask that represents coefficients which 
belong to the ROI in each subband, and outputs that 
mask to the entropy decoder 602. 

The flow of the operation of the decoding device 
6 in this embodiment will be described below with 
reference to the flow chart in Fig. 23. 

The decoding device 6 reads out a code sequence 
corresponding to one subband from the subsequent code 
sequence (step S201) . Then, the lower-limit bit plane 



B = ceil (log2 (e) ) 



(20) 
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of decoding in the entropy decoding process is set to 
be the bit shift value B contained in the code sequence 
(step S202) . 

Codes corresponding to one bit plane of 
5 quantization are decoded to restore that bit plane 

(step S203) . It is checked if the bit plane restored 
in step S203 is the lower-limit bit plane determined in 
the previous step (step S204), If the restored bit 
plane is the lower-limit bit plane, the flow advances 

-IPS? 

10 to step S205; otherwise, the flow returns to step S203 
™ to proceed with the process for the next lower bit 

2^ plane. 

The quantization indices that belong to the ROI 
O are shifted down by B bits with reference to the mask 

M 15 input from the mask generator 605, and dequantization 

p is executed (step S205) . At this time, all bits 

contained in non-decoded bit planes in quantization 
indices that belong to the non-ROI region (bits 
contained in bit planes contained in the non-ROI 
20 region) are set at zero. Fig. 20C shows the 

quantization indices after the shift down process, and 
bits with X marks in quantization indices of the 
non-ROI region in Fig. 20C are not decoded and are 
forcibly set at zero. 
25 It is then checked if a process for all the 

subbands is complete (step S206) . If subbands to be 
processed still remain, the flow returns to step S201 



to process the next subband. The inverse discrete 
wavelet transforms of the obtained transform 
coefficients are computed to reconstruct an image, 
which is outputted to the image display device 7. 
5 In this embodiment, the shift value B is computed 

in correspondence with a noise level, and that shift 
value B directly determines the lower-limit bit plane. 
That is, since the bit plane of the ROI need only be 
shifted up to the lower-limit bit plane, a noise 
^ 10 removal effect can be obtained by fewer processing 

steps. 

In the third and fourth embodiments described 
above, the lower-limit bit plane is determined using 
D the values of the LL subband. However, upon 

M= 15 determining the lower-limit bit plane, a predetermined 

S| 

D region may be determined in a predetermined 

high-frequency subband, a noise level is estimated 
based on variations of coefficient values in that 
region, and the lower-limit bit plane may be determined 

20 based on that level in place of the coefficient values 
of the LL subband. 

Upon determining the shift value B upon encoding 
in this embodiment, the X-ray dosage upon image sensing 
may be directly used. Furthermore, data that 

25 represents the shape of the ROI may be contained in the 
code sequence. 
[Fifth Embodiment] 




An image processing system according to the fifth 
embodiment of the present invention will be described 
below . 

In the third embodiment, the ROI is set, and only 
5 noise components of the non-ROI region are removed. 
However, in this embodiment, the number of bit planes 
to be encoded in an image encoding process is 
controlled to implement a noise removal process without 
^ setting any ROI, 

^ 10 Since the arrangement of the image processing 

!^ system in this embodiment is substantially the same as 

that of the image processing system of the third 
-tU embodiment except for the internal arrangement of the 

Q encoding device 2, the internal arrangement and 

15 functions of the encoding device 2 will be explained 

below, and a description of other arrangements will be 
omitted. Fig, 24 shows an arrangement of the encoding 
device 2 in this embodiment. 

In the encoding device 2 according to this 
20 embodiment, a lower-bit plane designation unit 206 is 
provided in place of the region designation unit 204, 
and a code sequence forming unit 205 is added, unlike 
in the arrangement of the encoding device 2 of the 
third embodiment shown in Fig. 13. Other units (201, 
25 202, and 203) perform the same processes as those in 
the third embodiment . 
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Referring to Fig, 24, the lower-limit plane 
designation unit 206 stores data of the LL subband 
input from the discrete wavelet transformer 201 in a 
memory (not shown) . The lower-limit plane designation 
unit 206 obtains a lower-limit bit plane on the basis 
of the input coefficients of the LL subband, and the 
entropy encoder 202 performs bit plane encoding of code 
blocks using that lower-limit bit plane. 

Fig. 25 shows the relationship between the LL 
subband and a code block used to obtain the lower-limit 
bit plane in a transform coefficient group obtained 
upon computing the discrete wavelet transforms of two 
levels. In Fig. 25, Q indicates a code block used to 
obtain the lower-limit bit plane, and P indicates a 
coefficient region of the LL subband corresponding to Q. 

Since the subband structure generated by discrete 
wavelet transformation according to this embodiment is 
obtained by recursively segmenting a low-frequency 
range with a resolution = 1/2, which is obtained by 
decomposition of one level, a coordinate value 
indicating the position of a coefficient corresponding 
to Q can be multiplied by the number of levels upon 
decomposing 1/2 so as to obtain P from Q. The 
lower-limit bit plane designation unit 206 obtains the 
average value of coefficient values C(i,j) that belong 
to P, and computes a lower-limit bit plane BL of a code 
block B by: 




BL = 0; {ZC(i,j)}/N > Th (21) 
BL = m; {ZC(i,j)}/N < Th (22) 
where C(i,j) is a coefficient value at the position 
(i,j) in a local coordinate system in P, and m and Th 
5 are respectively a predetermined lower-limit bit plane 
and threshold value. Also, Z is an operator of a sum 
total arithmetic operation for i and j. 

The lower-limit bit plane is computed for each 
code block, is outputted to the entropy encoder 202, 
10 and is stored in a memory (not shown) . Note that 
lower-limit bit planes are set for high-frequency 
subbands except for LL, and all bit planes are to be 
encoded for LL. A decomposition level to which 
subbands to be encoded belong is determined in advance 
15. based on the characteristics of noise and the like. 

For example, when subbands belonging to level 1 are to 
be encoded, lower-limit bit planes are set for three 
subbands HLl, LHl, and HHl, That is, lower-limit bit 
planes are set for high-frequency subbands in a region 
20 where transform coefficients of a low-frequency range 
in an image are small. 

After the lower-limit bit planes are set, bit 
planes of quantization indices generated upon 
quantizing the transform coefficients are encoded in 
25 turn from the MSB until the corresponding lower-limit 
bit plane is reached. 
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The code sequence forming unit 205 receives the 
code sequence generated by the entropy encoder 202, and 
forms a code sequence by appending predetermined header 
information and the like to that code sequence so as to 
5 output the input code sequence to the file output 

device 3. That is, the code sequence forming unit 205 
performs some of processes of the file output device 3 
described in the third embodiment. 

The aforementioned processes in the encoding 

10 device will be briefly described below using the flow 
chart in Fig. 26. 

The discrete wavelet transforms of an image 
signal are computed to generate transform coefficients 
(step S2101) . One subband other than the LL subband is 

15 determined. For example, when an HLl subband is 

selected, a corresponding coefficient region in the LL 
subband is specified in each code block in the HLl 
subband (step S2102) . The average value of transform 
coefficients in the coefficient region in the LL 

20 subband specified in step S2102 is computed (step 
S2103) . 

It is checked if this average value is equal to 
or larger than Th (step S2104) . A lower-limit bit 
plane is set as described by equation (21) or (22) in 
25 accordance with the checking result (step S2105, step' 
S2106) . 
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It is checked if the processes in steps S2102 to 
S2106 have been executed for all code blocks (step 
S2107). If the processes have been executed for all 
code blocks, the flow advances to step S2108; otherwise, 
the flow returns to step S2102 to execute the 
aforementioned processes for an unprocessed code block. 

The transform coefficients are quantized to 
generate quantization indices (step S2108), these 
quantization indices are mapped on bit planes (step 
S2109) , and these bit planes are encoded up to the 
lower-limit bit plane position obtained for each code 
block (step S2110, step S2111) . Then, the 
aforementioned code sequence is generated. 

The decoding device 6 in this embodiment will be 
briefly described. The arrangement of this decoding 
device 6 is the same as that in the third embodiment, 
and the image decoding process is executed as follows. 
The entropy decoder 602 executes an entropy decoding 
process of encoded data of bit planes contained in the 
code sequence input via the code input unit 601, and 
the dequantizer 604 dequantizes quantization indices of 
the bit planes obtained by the decoding process so as 
to obtain transform coefficients of discrete wavelet 
transformation. The inverse discrete wavelet 
transformer 603 executes an inverse discrete wavelet 
transform process using these transform coefficients to 
reconstruct an image signal. 



With the aforementioned processes, since 
predetermined bit planes of an image signal 
corresponding to a code block and the lower-limit bit 
plane which is set to be a value other than zero upon 
5 encoding, are ignored, signal components in the 
high-frequency range are consequently limited. 
Therefore, when an image signal contains quantization 
noise or the like, an image from which such noise is 
removed is obtained during the encoding process, and 

10 the compressed image can be transferred or stored. 

Since encoding is aborted for bit planes which 
contain more noise components, compression efficiency 
drop, due to noise, can be prevented. 
[Sixth Embodiment ] 

15 An image processing system according to the sixth 

embodiment of the present invention will be described 
below. In the third to fifth embodiments described 
above, bit planes of each code block are encoded 
sequentially to form a code sequence. However, in this 

20 embodiment, a layer from which bit planes containing 

noise are removed is encapsulated in the code sequence 
upon forming the code sequence. 

Since the arrangement of the image processing 
system of this embodiment is substantially the same as 

25 that of the image processing system in the third 

embodiment except for the internal arrangement of the 
encoding device 2, the internal arrangement and 
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functions of the encoding device 2 will be explained 
below, and a description of other arrangements will be 
omitted. Fig. 27 shows an arrangement of the encoding 
device 2 in this embodiment. 

Referring to Fig. 21, reference numeral 207 
denotes a target compression ratio input unit for 
inputting a target compression ratio. The arrangement 
other than the target compression ratio input unit 207 
is the same as that in the fifth embodiment, and 
lower-limit bit planes in units of code blocks 
determined by the lower-limit bit plane designation 
unit 206 are output to the code sequence forming unit 
205. 

The code sequence forming unit 205 temporarily 
stores codes generated by the entropy encoder 202 in a 
buffer (not shown) , and forms a code sequence which has 
a code size corresponding to the target compression 
ratio input from the target compression ratio input 
unit 207, and maximizes the image quality of an image 
reconstructed upon decoding. 

This state will be explained below with reference 
to Fig. 28. As shown in Fig, 28, a bitstream made up 
of code blocks CBO to CB2 is stored in a memory in the 
code sequence forming unit 205, and code blocks CBO, 
CBl, and CB2 respectively have codes corresponding to 
five, three, and four bit planes. The code sequence 
forming unit 205 forms a layer by appropriately 



selecting bit planes from the code sequences of the 
stored code blocks. 

The layer is formed by combining codes of a 
plurality of bit planes selected from a plurality of 
5 code blocks, as shown in Fig, 28. For example, layer 0 
contains the most significant bit planes of CBO and CB2, 
and layer 1 contains a bit plane of level 3 of CBO, a 
bit plane of level 2 of CBl, and a bit plane of level 2 
of CB2 . Bit planes and code blocks to be combined to 
10 form a layer are determined based on predetermined 
criteria. 

Therefore, in Fig. 28 the code sequences of code 
blocks are not always formed in units of identical bit 
planes unlike those in Fig. 16. Information indicating 
15 code blocks included in a given layer is contained in 
the header PH. 

Upon forming such code sequence, the code 
sequence forming unit 205 switches the code block 
selection method so as not to select code sequences 
20 corresponding to bit planes below the lower-limit bit 
plane in each layer with reference to the lower-limit 
bit planes in units of code blocks determined by the 
lower-limit bit plane designation unit 206. 

Furthermore, the code sequence forming unit 205 
25 adjusts the code sequence so that its final length 
satisfies the designated compression ratio. This 
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adjustment can be implemented by cutting a code 
sequence of a lower layer. 

According to the aforementioned method, the code 
sequence is formed to minimize distortion with respect 
to the designated compression ratio. But since 
lower-limit bit planes are set for specific code blocks 
and components corresponding to noise are not 
considered in distortion improvement, an image which 
has an improved image quality as a whole, and can 
suppress noise can be obtained upon decoding that code 
sequence . 

Note that the target compression ratio input unit 
207 may comprise a driver for computing the target 
compression ratio in addition to a keyboard, mouse, and 
the like. That is, a driver (not shown) may detect in 
advance a maximum storage capacity of a storage medium 
that stores the code sequence, and may input a target 
compression ratio computed based on the detected 
maximum storage capacity of the storage medium and the 
code sequence size to the code sequence forming unit 
205. 

According to the third to sixth embodiments, upon 
compressing, decoding, and displaying an image 
containing noise, noise can be removed without 
requiring any special noise removal process, and an 
image with high image quality can be generated. 
[ Seventh Embodiment ] 



An image processing system according to the 
seventh embodiment of the present invention will be 
described below. Since the arrangement of the image 
processing system in this embodiment is substantially 
the same as that of the image processing system of the 
first embodiment except for execution of quantization 
and the internal arrangement of the decoding device 6, 
the internal arrangement and functions of the decoding 
device 6 will be explained below, and a description of 
other arrangements will be omitted. 

Fig. 29 shows a schematic arrangement of the 
encoding device 2. An image signal input to the 
encoding device 2 undergoes discrete wavelet 
transformation in the discrete wavelet transformer 201 
to generate transform coefficients. The transform 
coefficients are quantized by the quantizer 203, and 
are encoded by the entropy encoder 202. The encoded 
data is input to the code sequence forming unit 205 to 
form a code sequence. Since the discrete wavelet 
transformer 201 has the same arrangement and functions 
as those described in the first embodiment, and the 
entropy encoder 202 and quantizer 203 have the same 
arrangements and functions as those described in the 
third embodiment, a description thereof will be omitted. 

The code sequence forming unit 205 forms a code 
sequence by appending predetermined header information 



and the like so as to output input codes to the file 
output device 3. 

Figs, 30A to 30E show the format of the code 
sequence which is generated and outputted in this way. 
5 Fig. 30A shows an overall format of a code sequence, in 
which MH is a main header; TH, a tile header; and BS, a 
bitstream. As shown in Fig. 30B, the main header MH is 
comprised of the size (the numbers of pixels in the 
horizontal and vertical directions) of an imaqe to be 
^ 10 encoded, a size upon breaking up the image into tiles 

W as a plurality of rectangular regions, the number of 

IxJ components indicating the number of color components, 

the size of each component, and component information 

m 

P indicating bit precision. In this embodiment, since an 

^ 15 image is not broken up into tiles, the tile size is 

1^ equal to the image size. When the image to be encoded 

is a monochrome multi-valued image, the number of 
components is "1". 

Fig. 30C shows a format of the tile header TH. 
20 The tile header TH consists of a tile length including 
the bitstream length and header length of the tile of 
interest, and an encoding parameter for the tile of 
interest. The encoding parameter includes a discrete 
wavelet transform level, filter type, and the like. 
25 Fig. SOD shows a format of the bitstream in this 

embodiment- In Fig. 30D, a bitstream is formed in 
units of subbands, which are arranged in ascending 
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order of resolution to have a subband with the lowest 
resolution at the head position. Furthermore, in each 
subband, codes are arranged in units of bit planes in 
the order from the upper to lower bit planes. 

Codes of each bit plane of the LL subband are 
arranged in units of code blocks, as shown in the 
second lowermost column of Fig. 30D, and PH contains 
the difference between a maximum bit plane SB of each 
code block and a corresponding bit plane S, information 
for designating code blocks contained in the bit plane 
of interest, and the like. In Fig. 30D, bit plane 
(s-1) contains codes of four code blocks (CB0_S-1, 
CB1_S-1, CB2_S-1, CB3_S-1), and PH can designate code 
blocks, the corresponding codes of which are not 
present in the bit plane of interest. 

Fig. 30E shows an arrangement of bit plane codes 
of another subband. The code sequence generated in 
this way is outputted to the file output device. 

In this embodiment, codes of each subband are 
formed in units of bit planes which are arranged in the 
order from the MSB to the LSB, but need not always be 
formed in units of bit planes. For example, a layer 
which combines encoded data corresponding to a 
predetermined number of bit planes from the most 
significant bit plane may be used as a unit. 

In this case, PH contains information indicating 
the number of bit planes corresponding to the codes of 
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the contained code blocks in addition to information 
indicating whether the code blocks are contained. 

Upon adopting JPEG2000, each bit plane is encoded 
while being segmented into a plurality of passes. 
5 Encoded data contained in each layer may be arranged in 
units of passes. In this case, PH contains information 
indicating the number of passes of codes of the code 
blocks contained. 

Fig. 35 is a flow chart of a compression encoding 

10 process executed by the image processing system of this 
embodiment mentioned above, and the process will be 
described below. 

An image is input (step S3501), undergoes 
discrete wavelet transformation (step S3502), and is 

15 then quantized (step S3503) . Each subband is segmented 
into code blocks (step S3504), and quantization indices 
are decomposed into bit planes in units of code blocks 
(step S3505) . The code blocks contained in all the 
subbands (step S3507) undergo binary arithmetic coding 

20 (step S3506) , and the aforementioned header information 
is appended to the binary arithmetic coding result 
(code sequence) to generate an image file (step S3508) . 
The image file is then output (step S3509) , 

The decoding process in the image processing 

25 system according to this embodiment will be described 
below. An image file stored by the storage/transfer 
device 4 is read by the file input device 5, and is 
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separated into appended data appended by the file 
output device 3, and the code sequence generated by the 
encoding device 2, The code sequence is outputted to 
the decoding device 6 for a decoding process. 
5 Fig. 31 is a block diagram showing an arrangement 

of the decoding device 6 of this embodiment. Reference 
numeral 601 denotes a code input unit; 602, an entropy 
decoder; 603, an inverse wavelet transformer; 604, a 
^ dequantizer; 606, an image quality improvement 

^ 10 processor; 607, a controller; and 608, a reference 

yy image memory. 

hi The code input unit 601 receives a code sequence, 

analyzes header information contained in that code 
Q sequence to extract parameters required for the 

2 15 subsequent processes, and sends the extracted 

^ parameters to the controller 607. Bitstreams contained 

^ in the code sequence are output to the entropy decoder 

602. 

The entropy decoder 602 decodes and outputs the 
20 bitstreams in units of bit planes. 

The entropy decoder 602 decodes and outputs the 
bitstreams in units of bit planes as in the first 
embodiment described using Fig. 8. 

The dequantizer 604 restores discrete wavelet 
25 transform coefficients c* from the input quantization 
indices in the same manner as in the third embodiment 
described using equations (18) and (19) . The transform 



10 by: 



coefficients c' are output to the image quality 
improvement processor 606. 

The image quality improvement processor 606 
selects a pixel which is to undergo an image quality 
improvement process from those belonging to subbands 
other than an LL subband as a low-frequency subband on 
the basis of predetermined conditions, and performs a 
comparison process of a transform coefficient c' of the 
selected pixel with a predetermined threshold value T 



cn = 0 ; abs (c ' ) < T (23) 
cn = c*; abs(c') > T (24) 
Then, the processor 606 outputs the comparison result 
to the inverse discrete wavelet transformer 603. 

15 The processed discrete wavelet transform 

coefficients cn are output to the inverse discrete 
wavelet transformer 603. Note that the threshold value 
T varies depending on the subband to which a 
coefficient to be processed belongs. 

20 The inverse discrete wavelet transformer 603 

computes the two-dimensional inverse discrete wavelet 
transforms of the input transform coefficients to 
reconstruct an image signal. The two-dimensional 
inverse discrete wavelet transform process is 

25 controlled by the controller 607. 

The overall operation of the decoding device 6 
will be explained. The controller 607 controls the 

- 61 - 



code input unit 601 to input encoded data corresponding 
to a predetermined number of subbands of those 
contained in the code sequence shown in Fig. 30A. In 
this embodiment, encoded data corresponding to an LL 
subband in Fig. 30D are read. 

The read encoded data corresponding to the LL 
subband are output to the entropy decoder 602 to 
undergo a decoding process, thus restoring quantization 
indices. Furthermore, the restored quantization 
indices are dequantized by the dequantizer 604 to 
restore transform coefficients that belong to the LL 
subband . 

The restored LL subband coefficients are output 
to the image quality improvement processor 606. In 
this case, the controller 607 controls the image 
quality improvement processor 606 to directly output 
the input coefficients without any process. The LL 
subband coefficients output from the image quality 
improvement processor 606 in this way undergo inverse 
transformation in the inverse discrete wavelet 
transformer 603. At this time, since subbands other 
than LL are not decoded yet, all transform coefficients 
are processed as zero. 

That is, when transformation of two levels is 
done upon encoding, an image signal is generated by 
making computations under the assumption that zero 
coefficients are contained in all subbands HL2, LH2, 



# 



HH2, HLl, LHl, and HHl, as shown in Fig. 32. The image 
generated in this manner will be referred to as a 
reference image hereinafter. The reference image is 
outputted to and stored in the reference image memory 
5 608, 

The controller 607 controls the code input unit 
601 to read the subsequent code sequence. In this 
embodiment, the subsequent code sequence contains 
encoded data corresponding to all subbands other than 
^ 10 LL in Fig. 30D. These encoded data undergo decoding 

y£ and dequantization in the same manner as described 

W above to restore transform coefficients, which are 

input to the image quality improvement processor 606. 
□ The image quality improvement processor 606 

15 selects pixels which are to undergo an image quality 

improvement process on the basis of the pixel values of 
^ the reference image stored in the reference image 

memory 608. That is, a region of pixels to be 
processed on the reference image is detected, and when 
20 M represents the average value of the pixel values 

(more specifically, luminance values) in that region, a 
process described by equation (23) or (24) is done as 
long as: 

M < Ti (25) 
25 where Ti is a value (threshold value) determined by an 
X-ray image sensing situation. In this manner, an 
image quality improvement process is executed for 
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high-frequency subband pixels which correspond to a 
given region in the reference image in which the 
average luminance value is less than Ti. 

Fig. 33 shows the relationship between the 
5 coefficients and reference image at that time. When 

four pixels a, b, c, and d in a region on the reference 
image correspond to a coefficient C in HLl to be 
processed, we have: 
Q M=(a+b+c+ d) /4 (26) 

^ 10 When this value M corresponds to a region less than Ti, 

rz the absolute value of that coefficient C is compared 

^ with T. If the absolute value of the coefficient C is 

smaller than T, the coefficient C is determined to be 
O noise, and is converted into zero. The coefficients 

15 processed in this way are output to the inverse 
Q discrete wavelet transformer 603. 

The inverse discrete wavelet transformer 603 
computes the inverse discrete wavelet transforms of the 
sequentially input coefficients of the subbands other 
20 than LL and those of the previously input LL subband in 
combination to generate an image signal (image), and 
outputs the image to the image display device 7, thus 
displaying an image. Fig. 36 is a flow chart that 
summarizes the aforementioned decoding process in this 
25 embodiment. Individual processes in the flow chart 
will be explained below. 
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An image file stored by the storage/transfer 
device 4 is read out (step S3601), and parameters and 
code sequence are extracted from the file (step S3602). 
Transform coefficients contained in subbands other than 
5 the LL subband are. set at zero, and the aforementioned 
reference image is generated using the decoding process 
mentioned above (step' S3603) . 

The subbands other than the LL subband undergo 
entropy decoding and dequant ization to obtain transform 
10 coefficients (step S3604). A region on the reference 
7z image corresponding to transform coefficients in a 

J{ given subband other than the LL subband is obtained, 

and the average value M in this region is computed 
D (step S3605) . A threshold value process described by 

15 equations (23) and (24) is done (step S3607) in 
□ accordance with a discrimination process described by 

inequality (25) (step S3606) . The processes in steps 
S3605 to S3607 are repeated for transform coefficients 
in all subbands other than the LL subband (step S3608) . 
20 Then, inverse discrete wavelet transformation is done 
using the coefficients of the LL subband together to 
generate an image signal (step S3609) , and the image 
signal is displayed (step S3610) . 

In an image obtained by an X-ray image sensing 
25 device, a low luminance level portion of the image has 
a low X-ray transmittance, resulting in many noise 
components and poor S/N ratio. Therefore, in this 
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embodiment, upon decoding the code sequence obtained by 
compression-encoding an image, only the 
lowest-frequency subband in the code sequence is 
decoded to generate the reference image. Since this 
reference image represents an average luminance level 
of an original image, many quantization noise 
components are contained in a low luminance level 
region in the reference image. When high-frequency 
coefficients corresponding to such region undergo a 
threshold value process, an effective noise removal 
process is implemented, and an image with the improved 
image quality can be obtained. 

In this embodiment, high-frequency subband 
coefficients undergo a threshold value process on the 
basis of formulas (23), (24), and (25). However, the 
present invention is not limited to such specific 
process. For example, the image quality improvement 
processor 606 may convert the input coefficient c' by: 

cn = f (c* ) (27) 
where f(x) is a function having predetermined 
input/output characteristics. For example, when the 
function has the input/output relationship shown in 
Fig. 34, a value of a coefficient not more than a given 
input level is suppressed, while values within a given 
range are emphasized. 

When predetermined high-frequency subband 
coefficients undergo conversion described by equation 
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(27) , noise components with small values are suppressed, 
and signal components having sufficiently large values 
can be emphasized, thus improving the image quality 
after inverse transformation. 

In this embodiment, only the LL subband is used 
upon generating the reference image. However, the 
present invention is not limited to this. More 
specifically, a predetermined number of subbands with 
respect to encoded data of subbands contained in the 
code sequence may be used. 

Fig. 37 shows a subband format upon generating a 
reference image by reading encoded data corresponding 
to HL2, LH2, and HH2 in addition to LL. In Fig. 37, 
all coefficients of subbands HLl, LHl, and HHl are set 
at zero, but decoded values are used for the remaining 
subbands . 

In this embodiment, a reference range with 
respect to the reference image is limited to a region 
of coefficients to be processed on an original image. 
Alternatively, a broader range may be set as a 
reference region. For example, in this embodiment, a 2 
X 2 pixel region (a to d) is referred to for the 
coefficient C in Fig. 33. Alternatively, the average 
value may be computed for a coefficient C2 with 
reference to a 4 x 4 region indicated by R. By 
changing the reference region in this way, a process 
suited to a local feature of an image can be done. 
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That is, a process can be done without being influenced 
by fine changes in image by setting a broader reference 
region . 

In this case, the user may interactively 
5 determine the reference range of the reference image. 
For example, the reference image may be displayed in 
practice, and the user may designate a portion that 
requires higher image quality on the displayed image, 
p thereby determining the reference range upon processing 

m 10 coefficients corresponding to the designated portion, 

in Iri this case, when a small reference range is set for 

E „ ; 

ry portion that requires higher image quality, and a 

broader reference range is set for other portions, an 
adaptive image quality improvement process can be 
15 implemented . 
D [Other Embodiments] 

Note that the present invention is not limited to 
a system comprising a plurality of devices, but may be 
applied to a single apparatus constituted by parts 
20 having functions of those devices. 

The scope of the present invention includes not 
only each of the first to seventh embodiments, but also 
various combinations of these embodiments. 

Furthermore, the present invention is not limited 
25 to the system and method alone for implementing the 
aforementioned embodiments, but the scope of the 
present invention includes a case wherein the above 
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embodiments are achieved by supplying a program code of 
software that can implement the functions of the 
above-mentioned embodiments to a computer (or a CPU or 
MPU) in a system or apparatus, and making the computer 
control various devices in the system or apparatus. 

In this case, the program code itself read out 
from the storage medium implements the functions of the 
above-mentioned embodiments, and the program code 
itself, and means for supplying the program code to the 
computer (i.e., a storage medium which stores the 
program code) are included in the scope of the present 
invention . 

As the storage medium for storing such program 
code, for example, a floppy disk, hard disk, optical 
disk, magneto-optical disk, CD-ROM, magnetic tape, 
nonvolatile memory card, ROM, and the like may be used. 

The program code is included in the scope of the 
embodiments not only when the functions of the above 
embodiments are implemented by controlling various 
devices according to the supplied program code alone 
but also when the functions of the embodiments are 
implemented by collaboration of the program code and an 
OS (operating system) or another application software 
running on the computer. 

Furthermore, the scope of the present invention 
includes a case wherein the functions of the 
above-mentioned embodiments are implemented by some or 
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all of actual processing operations executed by a CPU 
or the like arranged in a function extension board or a 
function extension unit, which is inserted in or 
connected to the computer, after the supplied program 
5 code is written in a memory of the extension board or 
unit . 

When the present invention is applied to the 
aforementioned storage medium, that storage medium 
stores program codes corresponding to the flow charts 
10 described above. To restate, according to the present 
invention, noise contained in an original image can be 
removed upon compressing/decoding an image in units of 
bit planes. 

As many apparently widely different embodiments 
15 of the present invention can be made without departing 
from the spirit and scope thereof, it is to be 
understood that the invention is not limited to the 
specific embodiments thereof except as defined in the 
appended claims. 
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